METHOD OF ANALYZING FRINGE IMAGE HAVING SEPARATE 

REGIONS 



RELATED APPLICATIONS 
[0001] This application claims the priority of Japanese Patent Application No. 
2000-383264 filed on December 18, 2000, which is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 
Field of the Invention 
[0002] The present invention relates to a method of analyzing a fringe image 
having separate regions. In this method, numerical data are obtained by observing 
fringe images such as interference fringes, moire fringes, photoelastic fringes, and 
Schlieren fringes in measurement of surface forms and transmitted wavefront 
measurement in which forms are observed as being divided by structures, structures 
of objects themselves, structures of observing means, or the like, such as surface 
form measurement of objects having groove-like structures in relatively smooth 
surface forms like chuck discs, whetstones for grinding and polishing, clutch plates 
for automobiles, and grooved optical prisms; face measurement by use of an optical 
wavefront through a crisscross scale, a viewer window with a reinforcement, and 
moire gratings with reference lines; and the like. 

Description of the Prior Art 
[0003] Along with the advance of industrial technology, the demand for 
accurately measuring objects has been increasing. Also, the product control by 
means of computers has advanced, whereby results of measurement of objects have 
been required more and more in the form of numerical values. 

[0004] Measurement means includes point measurement method in which the 
whole is measured as an assembly of point measurements, and pattern measurement 
method in which the whole is measured in terms of analog information whereas the 
numerical value of each point is determined by image analysis. 

[0005] The point measurement method is advantageous in that results are 
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obtained as numeric values per se at the time of measurement, but it takes time if 
the number of measurement points increases, thereby inevitably becoming 
susceptible to disturbance during the measurement. 

[0006] On the other hand, though the measurement time is short in the pattern 
measurement method, the results obtained as analog information must be converted 
into numerical information. 

[0007] Hence, there have been attempts to carry out efficient 
inspection/measurement by combining the point measurement and pattern 
measurement together in the industry. For an optical lens, by way of example, the 
point measurement is employed for inspecting its center thickness and outer 
diameter, whereas the pattern measurement is employed when it is necessary to 
finely inspect the whole surface as in surface form inspection and material density 
inspection. 

[0008] A typical example of the pattern measurement is fringe image 
measurement represented by interference fringes and moire fringes. The fringe 
analysis method in which the numerical information of each point is determined from 
a fringe image has become easy to carry out thanks to computers, the increase in 
their memory in particular. 

[0009] Typical examples of fringe analysis method include the fringe-thinning 
method described in "Applied Optics - Introduction to Optical Measurement," pp. 
185-195, published by Maruzen Co., Ltd., and the phase shift fringe analysis method 
(also known as fringe scanning method or phase scanning method) described in 
"PHASE-MEASUREMENT INTERFEROMETRY TECHNIQUES," PROGRESS IN 
OPTICS . Vol. XXXVI (1988), pp. 349-393. 

[0010] The above-mentioned fringe-thinning method thins a fringe having a 
gradation in a fringe image by binary-coding at its peak position, calculates the 
ordinal number of each point in the fringe image with reference to its surrounding 
thinned fringe patterns, and multiplies it by a sensitivity per fringe stripe, thereby 
determining numerical values of all the points of the fringe image. 
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[0011] The phase-shift fringe analysis method measures changes in brightness 
in all the points of the fringe image in the process of scanning one stripe of the 
fringe pattern, and calculates the phase of each point from its results, thereby 
determining numerical values of all the points of the fringe image. 
[0012] In each of the above-mentioned fringe analysis methods, analyzable 
patterns are limited to those which are at least partly continuous, whereby fringe 
patterns occurring in a plurality of regions which are completely separated from each 
other by grooves and the like have been hard to analyze as a total of the plurality of 
regions even though the individual regions can discretely be taken out and analyzed. 
[0013] On the other hand, a method in which a phase calculation of each 
independent region is carried out and then the respective phases of separate regions 
are fitted in terms of least squares so as to provide each separate region with a 
phase relationship is described in Hiroaki Takajo and Tohru Takahashi, 
"Least-squares phase estimation from the phase difference," J.O.S.A. A/Vol. 5, No. 3, 
March 1988, pp. 416-425. 

[0014] The above-mentioned technique of fitting a wavefront in terms of least 
squares is quite effective against dust and dirt, vibrations, turbulence in air, and the 
like at the time of phase unwrapping as in amplitude-maximizing method, an 
execution condition for enabling the phase unwrapping will additionally be necessary 
if there is an independent start point for connecting phases because of the fact that 
separate regions exist. Also, it is necessary for this method to individually look for 
start points for connecting phases with respect to separate regions, so as to unwrap 
each separate region, estimate a phase of the whole by least squares thereafter, and 
then determine the phase of each separate region after arranging the independent 
start point for connecting phases into a phase difference of an integer multiple of 2ir, 
thereby necessitating a quite complicated calculation and taking a long analysis time. 
[0015] Meanwhile, in an inspection area separated into a plurality of 
independent regions by suction grooves as in a surface of a chuck disc for chucking a 
wafer in the making of IC, there has been a strong demand in the industry for 
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measuring with a high accuracy not only the respective surface forms of individual 
independent regions but also the surface form of the whole constituted by these 
independent regions. In mass-products such as grooved optical prisms, in 
particular, there has been a strong demand for shortening the measurement time 
since it greatly affects their cost and quantity of production. 

SUMMARY OF THE INVENTION 
[0016] In view of the foregoing circumstances, it is an object of the present 
invention to provide a method of analyzing a fringe image having separate regions, 
which can impart a mutual phase relationship to a plurality of independent inspection 
regions without yielding the problem of phase-connecting start point, thereby 
making it possible to measure not only the respective surface forms of the individual 
independent regions but also the surface form of the whole constituted by the 
independent regions at a high accuracy and a high speed. 

[0017] For overcoming such a problem, the present invention provides a 
method of analyzing a fringe image having separate regions, in which a fringe image 
carrying information of an object to be observed is analyzed so as to obtain the 
information of the object, the fringe image being constituted as an assembly of a 
plurality of separate independent fringe image regions, the method comprising the 
steps of: 

providing a mask to a gap separating the plurality of fringe image regions 
from each other; rendering a virtual fringe distribution to thus obtained mask region 
so as to yield a single continuous fringe image region; analyzing the whole surface of 
thus obtained single fringe image region by use of a predetermined fringe analysis 
method; and deleting information of the mask region from information of the single 
fringe image region obtained by the whole surface analysis, so as to yield desirable 
information of the fringe image, thereby making it possible to analyze the fringe 
image having separate regions. 

[0018] In the method of the present invention, the mask corresponding to a gap 
for separating the plurality of fringe image regions from each other may be formed 
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by rendering a threshold to a modulation of the fringe image captured by imaging 
means, binary-coding the fringe image according to the threshold, preparing a 
blurred image by averaging each pixel of the binary-coded image and a pixel in the 
vicinity thereof, and setting a mask threshold thereafter according to a brightness of 
the blurred image. 

[0019] The fringe image may be one obtained by a lightwave interferometer. 
[0020] The fringe image may be one obtained by a moire profilometer. 
[0021] The object to be observed may be a measurement member having a slit 
per predetermined pitch. 

[0022] The processing of the blurred image may be omitted when the fringe 
image has a favorable contrast. 

[0023] The processing for providing the mask may manually be carried out 
while observing the fringe image. 

[0024] The threshold in the modulation of the fringe image may be set by a 
distribution graph of modulation prepared according to maximum and minimum 
values of the modulation of fringe image determined over the whole surface of 
means for displaying the fringe image, and a modulation value yielding the lowest 
modulation distribution while being located in the vicinity of zero in a differentiation 
graph determining a change ratio in the distribution graph of the modulation. 
[0025] A boundary position of the mask provided so as to correspond to the gap 
for separating the plurality of image regions from each other may be determined by 
binary-coding the blurred image with the mask threshold, and then carrying out 
partial differentiation of a brightness of each point while scanning the whole surface 
of means for displaying thus binary-coded image in a scanning direction and/or a 
direction orthogonal to the scanning direction, so as to determine a point of change 
in brightness. 

[0026] The virtual fringe distribution may be rendered to the gap for separating 
the plurality of fringe image regions from each other by providing the mask to the 
fringe image and determining a brightness of the fringe image at a boundary position 
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of the mask and another boundary position opposite thereto in a scanning direction 
over the whole surface, determining a gradient of brightness between each pair of 
boundary positions from thus determined brightness, and providing a brightness 
having the gradient distribution between boundary positions corresponding to each 
pair of the masked boundary positions for complement. 

[0027] In the method of analyzing a fringe image having separate regions in 
accordance with the present invention, a virtual fringe distribution is provided to a 
gap separating the plurality of fringe image regions from each other so as to yield a 
continuous fringe image region, which is analyzed as a single fringe image region, 
and then data of the region provided with the virtual fringe distribution is deleted. 
Therefore, a mutual relationship is imparted to a plurality of independent inspection 
regions, whereby not only the respective surface forms of the individual independent 
regions but also the surface form of the whole constituted by the independent 
regions can be measured with a high accuracy at a high speed. 

[0028] In the case where a mask threshold is set by the brightness of a blurred 
mask prepared according to a threshold provided in the modulation of the fringe 
image, a smooth mask can automatically be prepared in the region for providing the 
virtual distribution even when the region has a complicated form or a part having an 
unfavorable image contrast. 

[0029] In the case where the modulation threshold of the fringe image is 
determined from the modulation distribution determined over the whole surface of 
means for displaying the fringe image and a change ratio distribution thereof, the 
threshold can be determined automatically. 

[0030] In the case where the blurred image prepared after binary-coding with 
the mask threshold is scanned over the whole surface so as to determine a point in 
change of brightness, a boundary of the mask corresponding to the region to provide 
the virtual fringe distribution can easily be determined. 

[0031] In the case where the brightness of the fringe image is measured over 
the whole surface at boundary positions holding therebetween the mask 

FK0904 SPC - 6 - 



corresponding to the gap for separating a plurality of fringe image regions from each 
other, and such a brightness distribution that the brightness between opposing two 
boundary positions changes smoothly is provided between the boundary positions, a 
mutual relationship can be imparted to a plurality of independent inspection areas. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0032] Fig. 1 is a flowchart showing the fringe image analyzing method in 
accordance with a first example of the present invention; 

[0033] Fig. 2 is a view showing a state where a mask is superposed on an 
interference fringe image in the first example; 

[0034] Fig. 3 is a view showing how to provide a virtual fringe to a mask region 
of the interference fringe image in the first example; 

[0035] Fig. 4 is a view showing results obtained when the fringe provided with 
the virtual fringe is totally analyzed in the first example; 

[0036] Fig. 5 is a view showing results obtained when the mask region is 
deleted from the results shown in Fig. 4; 

[0037] Fig. 6 is a flowchart showing the fringe image analyzing method in 
accordance with a second example of the present invention; 

[0038] Fig. 7 is a view showing how to provide a virtual fringe to a mask region 
of an interference fringe image in the second example; 

[0039] Fig. 8 is a view showing results obtained when the mask region is 
deleted from the results shown in Fig. 7; 

[0040] Fig. 9 is a flowchart showing the fringe image analyzing method in 
accordance with a third example of the present invention; 

[0041] Fig. 10 is a view for explaining a modulation mask in the third example; 
[0042] Fig. 11 is a view showing how to provide a virtual fringe to the 
modulation mask region of the interference fringe image in the third example; 
[0043] Fig. 12 is a view showing results obtained when the modulation mask 
region is deleted after the fringe image in the state of Fig. 11 is analyzed over the 
whole surface in the third example; 
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[0044] Fig. 13 is a flowchart showing the fringe image analyzing method in 
accordance with a fourth example of the present invention; 

[0045] Fig. 14 is a view showing how to provide a virtual fringe to a mask 
region of an interference fringe image in the fourth example; 

[0046] Fig. 15 is a view showing results obtained when the fringe provided with 
the virtual fringe is totally analyzed in the fourth example; 

[0047] Fig. 16 is a view showing results obtained when the mask region is 
deleted from the results shown in Fig. 15; 

[0048] Fig. 17 is a flowchart showing the fringe image analyzing method in 
accordance with a fifth example of the present invention; 

[0049] Fig. 18 is a view showing an interference fringe image obtained in the 
fifth example; 

[0050] Fig. 19 is a view showing a mask determined in the fifth example; 
[0051] Fig. 20 is a view showing how to provide a virtual fringe to the mask 
region of the interference fringe image in the fifth example; 

[0052] Fig. 21 is a view showing results obtained when the mask region is 
deleted from the results shown in Fig. 20; 

[0053] Fig. 22 is a flowchart showing the fringe image analyzing method in 
accordance with a sixth example of the present invention; 

[0054] Fig. 23 is a view for explaining a moire fringe image obtained in the sixth 
example; 

[0055] Fig. 24 is a graph showing a moire fringe image modulation distribution 

graph and a differentiation graph thereof in the sixth example; 

[0056] Fig. 25 is a view showing a mask determined in the sixth example; 

[0057] Fig. 26 is a view showing how to provide a virtual fringe to the mask 

region of the interference fringe image in the sixth example; and 

[0058] Fig. 27 is a view showing results obtained when the mask region is 

deleted from the results shown in Fig. 26. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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[0059] In the following, the fringe image analyzing method in accordance with 
an embodiment of the present invention will be explained with reference to drawings. 
Here, six examples shown in their corresponding flowcharts will be explained 
successively. Fig. 1 is a flowchart showing a first example of the present invention, 
which is an example of measurement of a reflecting object having a gap at a center 
part thereof by use of an interferometer. 

[0060] First, an interference fringe image obtained by use of the interferometer 
is stored into a memory (SI). Subsequently, as shown in Fig. 2, a rectangular mask 
is manually drawn so as to be superposed onto the above-mentioned image at a part 
corresponding to a gap (S2), and coordinates of a start line of the mask are 
determined (S3). Then, the brightness of the fringe image at the start line is 
recorded (S4), and a virtual fringe having a brightness on a par with that at the start 
line is imparted to the mask region (S5). The results are shown in Fig. 3. 
Subsequently, the fringe provided with the virtual fringe is analyzed over the whole 
surface (S6). The results are shown in Fig. 4. Thereafter, the virtual fringe form 
provided to the mask region is deleted (S7). The results are shown in Fig. 5. 
[0061] Fig. 6 is a flowchart showing a second example of the present invention, 
which is an example of measurement of a reflecting object having a gap at a center 
part thereof by use of an interferometer as in the first example. To begin with, as 
in the first example, an interference fringe image is stored into a memory (Sll), and 
masking is carried out (S12). Thereafter, in this example, a mask boundary is 
determined (S13). Subsequently, the brightness of the fringe image at a boundary 
position of the mask is recorded (S14), and the gradient concerning brightness 
between opposing boundary positions is calculated (S15). Using thus calculated 
gradient concerning brightness, a virtual fringe is imparted to the mask region (S16). 
The results are shown in Fig. 7. Thereafter, as in the first example, the fringe 
provided with the virtual fringe is analyzed over the whole surface (S17), and the 
virtual fringe form provided to the mask region is deleted (S18). The results are 
shown in Fig. 8. 
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[0062] Fig. 9 is a flowchart showing a third example of the present invention, 
which is an example of a case where a mask (hereinafter referred to as modulation 
mask) is determined by use of a threshold according to a modulation of a fringe 
image, and this modulation mask is used. In this example, since the contrast of a 
picture is not always unfavorable, a modulation mask such as the one shown in Fig. 
10 can be determined even when no blurred image processing is carried out (S21 to 
S23). Subsequently, the fringe image is binary-coded (S24), a mask start line is 
determined (S25) as in the first example, the brightness of the fringe image at the 
start line of the modulation mask is recorded (S26), and a virtual fringe image having 
a brightness on a par with that at the start line is provided to the modulation mask 
region (S27). The results are shown in Fig. 11. Thereafter, the whole surface of 
the fringe image provided with the virtual fringe is analyzed (S28), and the virtual 
fringe form provided to the mask region is deleted (S29). The results are shown in 
Fig. 12. 

[0063] Fig. 13 is a flowchart showing a fourth example of the present invention. 
The fourth example is also an example of measurement of a light-reflecting object 
having a gap at the center part thereof by use of an interference fringe, in which a 
modulation mask is formed as in the third example. Here, steps 31 to 34 (S31 to 
S34) correspond to steps 21 to 24 (S21 to S24) in the third example. Thereafter, 
data of the modulation mask is subjected to partial differentiation (S35), peak 
coordinates of partial differentiation are detected from the results of partial 
differentiation of the mask data (S36), and a mask boundary is determined from thus 
detected value (S37). Subsequently, the brightness of the fringe image at a 
boundary position of the mask is recorded (S38), and the gradient concerning 
brightness between opposing boundary positions is calculated (S39). Using thus 
calculated gradient concerning brightness, a virtual fringe is provided to the mask 
region (S40). The results are shown in Fig. 14. Thereafter, the whole surface of 
the fringe image provided with the virtual fringe is analyzed (S41). The results are 
shown in Fig. 15. Then, the virtual fringe form provided to the mask region is 
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deleted (S42). The results are shown in Fig. 16. 

[0064] When such a bright distribution that the brightness between two 
opposing boundary positions changes with a gradient is provided between the 
boundary positions, a mutual relationship can be imparted to a plurality of 
independent inspection regions. 

[0065] Fig. 17 is a flowchart showing a fifth example of the present invention. 
In the fifth example, an interference fringe image of a light-reflecting member 
having a slit per predetermined pitch, as shown in Fig. 18, obtained by use of an 
interferometer is initially stored into a memory (S51), a modulation of this fringe is 
calculated (S52), a threshold is set in the modulation of the fringe image (S53), the 
fringe image is binary-coded according to the threshold (S54), a blurred image is 
prepared by averaging each pixel of the binary-coded image with a pixel in the 
vicinity thereof (S55), and then a mask is determined by setting a mask threshold 
with the brightness of the blurred image (S56). Thus determined mask is shown in 
Fig. 19. A partial differentiation process is carried out with respect to the 
brightness of each point while the whole surface of mask data obtained by 
binary -coding with the mask threshold is scanned over the whole surface in a main 
scanning direction and a direction orthogonal thereto (S57), thereby yielding partial 
differentiation peak coordinates (S58), from which a boundary of the mask is 
determined (S59). Subsequently, the brightness of the fringe image at a boundary 
position of the mask is recorded (S60), the gradient of brightness between individual 
boundary positions is determined according to thus recorded brightness (S61), and a 
virtual fringe is provided to the mask region by using the gradient concerning 
brightness (S62). The fringe image provided with the virtual fringe is shown in Fig. 
20. Further, the whole surface of a single fringe image region provided with the 
virtual fringe is analyzed (S63), and then the information of the mask region is 
deleted from the information of the single fringe image region obtained by the whole 
surface analysis (S64). Thus obtained information is shown in Fig. 21. 
[0066] When a mask threshold is set with the brightness of a blurred image, a 
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smooth mask can automatically be prepared in the region for providing the virtual 
distribution even when the region has a complicated form or a part having an 
unfavorable image contrast. 

[0067] Fig. 22 is a flowchart showing a sixth example of the present invention, 
which is an example of analyzing moire fringes of a clutch plate having a grating-like 
slit by use of a flatness meter. First, a moire' fringe image obtained by use of the 
flatness meter is stored into a memory (S71). Subsequently, maximum and 
minimum values of a modulation are determined with respect to the whole of the 
fringe image, which is shown in Fig. 23 (S72, S73), and as shown in Fig. 24, a 
modulation distribution graph (S74) of the image and its differentiation graph (S75) 
are prepared according to the difference between the maximum and minimum values 
of the modulation. According to the modulation distribution graph of the fringe 
image and its differentiation graph, a modulation threshold is determined (S76). 
After the fringe image is binary-coded according to the threshold of the modulation 
(S77), each pixel of the binary-coded image is averaged with a pixel in the vicinity 
thereof, so as to prepare a blurred image (S78). Then, a mask threshold is set with 
respect to the brightness of each position of the blurred image, so as to determine a 
mask (S79). Thus determined mask is shown in Fig. 25. Thereafter, a partial 
differentiation process is carried out with respect to the brightness of each point 
while the mask data obtained by binary-coding is scanned in a main scanning 
direction and a direction orthogonal to the main scanning direction over the whole 
surface (S80), thereby yielding peak coordinates of the partial differentiation (S81), 
from which a boundary of the mask is determined (S82). Then, the brightness of 
the fringe image at a boundary position of the mask is recorded (S83), the gradient of 
brightness between individual boundary positions is determined according to the 
recorded brightness (S84), and a virtual fringe is provided to the mask region by 
using the gradient concerning brightness (S85). The fringe image provided with 
the virtual fringe is shown in Fig. 26. Further, a single fringe image region 
provided with the virtual fringe is analyzed over the whole surface (S86), and then 
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the information of the mask region is deleted from the information of the single 
fringe image region obtained by the whole surface analysis (S87). Thus obtained 
information is shown in Fig. 27. 

[0068] In this manner, a modulation threshold of the fringe image can be 
obtained from a modulation distribution and its change ratio distribution, whereby 
the threshold can automatically be determined. 

[0069] The method of analyzing a fringe image having separate regions is not 
limited to that of the above-mentioned embodiment, but can be modified in various 
manners. For example, each of the above-mentioned examples can similarly be 
applied to various fringe images without being restricted to interference fringes, 
moire fringes, and the like. 

[0070] In the case where a fringe image analysis for analyzing a fringe image so 
as to obtain information of a specimen is carried out by the method of analyzing a 
fringe image having separate regions in accordance with the present invention, even 
when the fringe image is constituted by an assembly of a plurality of independent 
fringe image regions separated from each other by a region such as a groove forming 
no interference fringe, a mask is provided in a gap separating the plurality of fringe 
image regions from each other, a virtual fringe distribution is provided to the mask 
region so as to yield a single fringe image, a fringe analysis is carried out thereafter, 
and then the data of the mask region is deleted, whereby the separated independent 
regions are provided with a phase relationship as explained in the foregoing. 
Therefore, the problem of start point for connecting phases does not occur at the 
time of connecting the respective phases of independent regions to each other. 
Also, since complicated calculations are not required, information of an object to be 
observed can be obtained at a high speed. 
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